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Abstract 



The logics of knowledge are modal logics that have been shown to be effective in represent- 
ee ■ ing and reasoning about knowledge in multi-agent domains. Relatively few computational 
frameworks for dealing with computation of models and useful transformations in logics 
of knowledge (e.g., to support multi-agent planning with knowledge actions and degrees 
^ ■ of visibility) have been proposed. This paper explores the use of logic programming (LP) 
to encode interesting forms of logics of knowledge and compute Kripke models. The LP 
modeling is expanded with useful operators on Kripke structures, to support multi-agent 
planning in the presence of both world-altering and knowledge actions. This results in the 
first ever implementation of a planner for this type of complex multi-agent domains. 

(*— ■; ■ KEYWORDS: planning, multi-agents, modal logics 
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^^ ■ 1 Introduction 

Modeling real-world planning scenarios that involve multiple agents has been an 
active area of research over the years. A considerable source of complexity derives 
from those scenarios where agents need to reason about knowledge and capabilities 
of other agents in order to accomplish their tasks. For example, a gambling agent 
needs to reason about what other players may know about the game in order to 
make the next move. Reasoning about knowledge and capabilities in multi-agent 
domains differs significantly from the same problem in single-agent domains. The 
complexity arises from two sources: (1) the representation of a planning domain 
needs to model not only the state of the world, but also the knowledge/beliefs of 
the agents; (2) the actions performed by an agent may lead to changes in knowledge 
and beliefs of different agents, e.g., action like announcements, cheating, lying, etc. 
Various modal logics have been developed for reasoning about knowledge in multi- 
agent systems (see, e.g., ( |Fagin et al. 199 5 Halpern 1995; van Ditmarsch et al. 2007|) ). 
The semantics of several of these logics is provided in terms of Kripke structures — 
where, intuitively, each Kripke structure captures the knowledge/beliefs of all the 
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agents. Naturally, when reasoning about knowledge of multiple agents in a dy- 
namic environment, it is necessary to devise operations for updating Kripkc struc- 



tures after the occurrence of an action, as suggested in (Bal tag and Moss 2004 
Ivan Benthem et al. 20 06; van Ditmarsc h et al. 2007|) . Two important questions, that 
have been less frequently considered, are: (1) how can one determine the initial 
model or the initial Kripke structure of a theory encoding the knowledge of the 
agents, and (2) what udpate operations on Kripkc structures are necessary to lay 
the foundations of a high-level multi-agent action language. 

The dominant presence of Kripke structures in different formalizations of multi- 
agent domains indicates that any system employing modal logic for reasoning and 
planning in multi-agent domains would need to implement some operations for the 
manipulation of Kripke structures. The lessons learned in the research in single- 
agent domains suggest that a high-level action language for multi-agent domains 
could be very useful. The development of such high-level language does not only 
help in modeling but also provides a new opportunity for the development of plan- 
ning systems operating on top of this language. The complexity of various rea- 
soning problems in modal logics (e.g., satisfaction, validity, etc.) and the difficulty 
in updating a Kripke structure after the occurrence of an event provide a com- 
putational challenge for logic programming. It is interesting to observe that, al- 
though there have been a few implementations of temporal logics in ASP (e.g., 
dHeljanko and Niemela 200"3{ISon et al. 20 06)). to the best of our knowledge, there 
has been no attempt in using logic programming for computing models of modal 
logics except in our recent work (Baral et al. 2010b). Our initial experience reveals 
that ASP-based implementation encounter severe difficulties, mostly associated to 
the grounding requirements of ASP. This also drives us to explore alternatives. 

In this paper, we investigate the use of Prolog in the development of a computa- 
tional framework for reasoning and planning in multi-agent domains. The advantage 
of Prolog lies in that it allows the step-by-step examination of parts of a Kripke 
structure without the need of constructing the complete structure. We focus on 
two initial aspects: computing the initial model of a theory of knowledge and ma- 
nipulating Kripke structures. To this end, we will make use of a high-level action 
language for the specification of various types of actions in multi-agent domains. 

2 Background: The Logics of Knowledge 



In this paper we follow the notation established in ( |Fagin et al. 1995 ). The modal 



language CKa builds on a signature that contains a collection of propositions T 
(often referred to as fluents), the traditional propositional connectives, and a finite 
set of modal operators Kj for each i in a set A. We will occasionally refer to the 
elements in the set A as agents, and the pair (A, J 7 } as a multi-agent domain. 

£/C_4 formulae are defined as follows. A fluent formulae is a propositional for- 
mula built using fluents and the standard Boolean operators V, A, ->, etc. A modal 
formulae is (i) a fluent formula, or (ii) a formula of the form K,^ where ip is a 
modal formula, or (Hi) a formula of the form ip V <fi, ip A <f>, or ->ip, where ip and <fi 
are modal formulae. In addition, given a formula ip and a non-empty set a C A: 
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• E a ip denotes the set of formulae {Kiip | i S a}. 

• C a ip denotes the set of formulae of the form E„i/>, where k > 1 and E^ +1 -0 = 
E^E Q V (and Ei V = E Q V)- 

An CICj, theory is a set of CICa formulae. 

The semantics of CICa theories is given by Kripke structures. A Kripke structure 
is a tuple (S, n, {/Q}ie.A)> where 5 is a set of state symbols, 7r is a function that 
associates an interpretation of T to each state in 5, and ICi C S x S for i E A. 

Different logic systems for reasoning with a CICa theory have been introduced; 
these differ in the additional axioms that the models are required to satisfy, e.g., 

• P: all instances of axioms of propositional logic 

• K: (Ki(p A Ki(tp =► <j>)) =► K l( f> 

• T: Kitp =► if 

• 4: Knp =S> KiK^p 

• 5: -iK^ip => K-i—H-iip 

• D: -iKifalse 

For example, the following modal logic systems are frequently used ( |Halpern 1997[ ): 
S5 satisfies all of the above axioms with the exception of (D), KD45 includes the 
four axioms K, 4, 5, and D, S4 includes the axioms K, T, and 4, and T includes 
the two axioms K and T. 

Given a Kripke structure M = (S, 7r, {fCi}t^X) an d a state s G S, we refer to 
the pair (M, s) as a pointed Kripke structure — and s is referred to as the real state. 
The satisfaction relation between £/C^-formulae and a pointed Kripke structure 
(M, s) is defined as follows: (i) (M, s) \= ip if ip is a fluent formula and ir(s) \= ip; 
(ii) (M,s) |= Kiip if (M,s') \= ip for every s' such that (s 7 s') € /C,;; and (Hi) 
(M , s) h ^ iff (M, s) ^ y>. 

We will often view a Kripke structure M as a directed labeled graph, with S 
as its set of nodes, and whose set of arcs contains (s,i,t) iff (s,t) € /Q. (s,i,t) is 
referred to as an arc, from the state s to the state t. We identify special types of 
Kripke structures depending on the properties of /C^: 

• M is r if, for each i £ A, ICi is reflexive relation; 

• M is rt if, for each i € A, ICi is reflexive and transitive; 

• M is rst if, for each i E A, ICi is reflexive, symmetric, and transitive; 

• M is elt if, for each i E A, ICi is transitive, Euclidean (i.e., for all s\, S2, S3, if 
(si,S2) 6 /Ci and (si,S3) 6 /C; then (52,^3) 6 /Q), and serial (i.e., for each s 
there exists s' such that (s, s') £ /Q). 

We use M [S], M[n], and M[i], to denote the components S, n, and ICi of M. 



3 A Simple Action Language for Multi-agent Domains 

In (jBaral et al. 2010aj) . we proposed an action language mA for multi-agent do- 
mains that considers various types of actions, such as world-altering actions, an- 
nouncement actions, and sensing actions. In this language, a multi-agent theory is 
specified by two components: a CICa theory and an action description. The former 
describes the initial state of the world and knowledge of the agents. The latter 
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describes the actions and their effects. We will next briefly describe the syntax of 
mA 

• The initial state description is specified by axioms of the form: 

o Modal logic system: includes one statement of the form system(n), where n G 

{T, S4, S5, KD45, none}. 
o Theory: includes statements of the form init(f), where f is a CK-a formula. 

• The action description consists of axioms of the following forms: 

a executable_if 6 (1) 

a causes cp if if performed_by a (2) 

a announces <j> performed_by a observed_by /3 (3) 

a determines / performed_by a observed_by /3 (4) 

where a is an action, a, j3 are sets of agents from A, 5 is an arbitrary dCj, formula, 

if and tp are conjunction of fluent literals (a fluent literal is either a fluent / G J- 

or its negation ~>f), ^ is a restricted formula (a fluent formula, a formula K^ip, 

or a formula -^(K-if V Kj(-iy)), where f is a fluent formula), and / is a fluent. 

An axiom of type ([1]) states the executability condition of the action a, ([2]) describes 

a world-altering action, ([3]) an announcement action, and (j4} a sensing action. For 

the sake of simplicity, we assume that the conditions ip in the axioms ([2]) for the 

same action a are mutually exclusive. An announcement will be referred to as a 

public announcement if a = A and = 0, otherwise it will be referred to as a 

private announcement. When it is a private announcement, we restrict to be a 

fluent literal. By (A, F, D, I) we denote a multi-agent theory over {A, F) with the 

initial state / and the action description D. 

Observe that all axioms describing actions include a part indicating the agents 
participating in the action, i.e., who executes the action (performed_by) and who 
is aware of the action occurrence (observed_by) . This is necessary, and dealing 
with this separation is one of the most difficult issues in reasoning about knowledge 
in multi-agent environments ( |Baltag and Moss 2004| ). 

Given a multi-agent theory (A, J 7 , D, I), we are interested in queries of the form 

if after [a x ; . . . ; a n ] (5) 

which asks whether if, a C1Ca formula, holds after the execution of the action 
sequence [a%, . . . , a n ] from the initial state. 

Example 1 

A, B, and C are in a room. On the table in the middle of the room is a box with 
a lock which contains a coin. No one knows whether the head or the tail is up and 
it is common among them that no one knows whether head or tail is up. Initially, 
A and C are looking at the box and B is not. One can peek at the coin to know 
whether its head or tail is up. To do so, one needs a key to the lock and looks at the 
box. Among the three, only A has the key for the lock. An agent can make another 
agent not to look at the box by distracting him/her. 

init (looking_at_box(a) ) . init (looking_at_box(c) ) . init (~looking_at_box(b)) . 
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init(~k(a,tail)) . init (~k(b,tail)) . init(~k(c,tail)) . 

init(~k(a,~tail)). init(~k(b,~tail)) . init (~k(c, "tail) ) . 

init (has_key(a) ) . init (~has_key(b) ) . init (~has_key (c)) . 

peek(X.Y) executable if looking_at_box(X) , looking_at_box(Y) , has_key(X) . 

distract (X,Y) executable if true. 

peek(X.Y) determines tail perf ormed_by X observed_by Y. 

distract (X,Y) causes ~looking_at_box(Y) if true performed by X. 



4 Computing the Initial State 

Computing an initial state of a multi-agent theory (A, J 7 , D, I) means to compute 
a pointed Kripke structure (M, s) satisfying / where (M, s) satisfies / if 

• (M, s) is a pointed Kripke structure w.r.t. the multi-agent domain (A,T); 

• For each init(ip) £ I we have that (M, s) \= cp; 

• If system{T) G / (resp. system(S4) , system(S5) , st/stem(KD45)), then M is 
r (resp. rt, rst, elt). 



4-1 Computing Initial State Using Answer Set Programming 



In (|Baral et al. 2010b)) . we proposed an answer set programming (ASP) (Marek and Truszczyiiski 1999 



Nicmcla 1999) implementation for computing the initial state of multi-agent the- 
ories. The implementation follows the basic idea of ASP by converting the initial 
state specification / to an ASP program 11/ (to) , with to being the number of states 
of the structure, whose answer sets are pointed Kripke structures satisfying /. The 
language of 11/ (to) includes: 

o A set of facts fluent(f) (agent(a)) for each / 6 T (resp. a 6 .4); 
o A set of constants s\, . . . , s ni representing the names of the possible states; 
o Atoms of the form state(S), denoting the fact that S is a state in the Kripke 

structure being built; 
o Atoms of the form h(<p, 5 1 ), indicating that the formula (p holds in the state S in 

the Kripke structure. These atoms represent the interpretation n associated with 

each state and the set of formulae entailed by the pointed Kripke structure; 
o Atoms of the form r(A, Si, S2), representing the accessibility relations of the 

Kripke structure, i.e., (5*1, S2) S ICa in the Kripke structure; 
o Atoms of the form t(S\, S2), used to represent the existence of a path from S± to 

S*2 in the Kripke structure present; 
o Atoms of the form real(S), to denote the real state of the world. 

We assume formulae to be built from fluents, propositional connectives, and modal 
operators (in keeping with our previous definition). In particular, the fact that a 
formula of the form K-aP holds in the current Kripke structure with respect to a 
state S is encoded by atoms of the form k(A, S, ip). 
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The creation of the model requires selecting which states and which connections 
should be included in the Kripke structure and is expressed by choice rules: 

l{state(si), . . . , state(s n )}m 4— 

0{h(F,S)}l <- fluent(F),state(S) 

0{r(A, Si, S 2 ) : state(Si) : state(S 2 )}l «- agent(A) 

l{real(S) : state(S)}l <- 

These rules will generate a pointed Kripke structure (M, s) whose states belong 
to {si, . . . , s n } with s indicated by real(s). The program is completed with rules 
determining the truth value of a formula in a given pointed structure. For instance, 
rules for checking whether an agent A knows a literal L arelj 

n.k(A,S,F) <- r(A,S t Si),h(->F,Si) 
n-k(A, S, -.F) «- r(A,S,Si),hiF,Si) 

k(A,S,L) <- not n_k(A,S,L) 

In addition to the above rules, 11/ (m) also contain rules encoding the additional 
properties imposed by a specific modal logic system: 

r(A, S, S) <— reflexivity,state(S),agent(A) 

r{A,S\,S 2 ) 4- symmetry,r(A,S 2 ,Si) 

r(A,Si,Ss) <r- transitivity, r(A, Si, S 2 ),r(A,S 2 , S3) 

l{r(A,S,T) : state(T)} -h- serial, state(S) 

r(A,S 2 , S3) <— euclidean,r{A,Sx,S 2 ),r{A,Sx,Sz) 

We can activate the necessary rules according to the modal logic system; e.g., if 
system(S4) € /, then we add the facts reflexive and transitive to 11/ (m). 

Finally, in order to ensure that a pointed structure satisfying / is generated, we 
add to II/(m) the constraint: 4— init(<p),real(S),noth(ip,S). 

The program 11/ (m) can be used not only to generate models of I but also to 
retrospectively identify properties of I given a history of action occurrences. In 
(jBaral et al. 2010b ~ | . we used 11/ (m) to solve the muddy children problem. 

For example, one of the Kripke structures generated for the initial specification 
of Example Q] includes: (1) two states {S — {s\,s 2 }), (2) the interpretations 7r(si) 
and it{s 2 ) make looking_at_box true for a, c and false, has_key true for a and false 
for b, c, and they differ on the truth value of tail (e.g., tail is true in 7r(si) and 
false in ir(s 2 )), and (3) {si,Sj) £ K x for each x 6 {a, b, c} and i, j £ {1, 2}. 



4-2 Computing Initial State Using Prolog 

The elegance of ASP encoding has unfortunately to deal with the complexity of 
grounding imposed by modern ASP systems — and this will motivate our contribu- 
tion of using Prolog for this task. Indeed, it is possible to find even simple theories 
of logics of knowledge that are beyond the capabilities of ASP. 



(Baral ct al. 2010b) contains rules for checking whether (M, s) entails other types of formulae. 
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Example 2 (Sum and Product) 

An agent chooses two numbers 1 < x < y such that x + y < 100. The sum x + y is 
communicated to agent s while the product x * y is communicated to agent p. The 
following conversation takes place between the two agents: 

• p states that it does not know the numbers x, y 

• s indicates that it already knew this fact 

• p states that now it knows the two numbers x, y 

• s states that now it knows the two numbers x, y as well. 

Let us consider the problem of generating an initial Kripke structure for the above 
story. The two agents are operating on states that can be represented by a pair 
(x, y) satisfying the given conditions. It is reasonable to assume that initially, the 
agents will need to consider all possible states. This is encoded in ASP by the rule: 

state(X, Y) <- 1 < X, X < Y, X + Y < 101 

It is easy to see that the number of states is 2352. To generate the initial Kripke 
structure using ASP, we would have to use the rule 

Q{r(A,state(X,Y),state(X 1 ,Y 1 ),Q) : state(X,Y) : state{X u Fi)}l ^ agent (A) 

which will produce 2352 2 ground rules for each agent during the grounding. Com- 
puting a model for a program consisting of only this rule and the rule defining the 
states is already impossibleo A reasonable (but ad-hoc) way is to use the rules 

r(s, state(X, Y),state(X 1 ,Y 1 ),0) <- X + Y = X x + Y u state(X, Y), state(X 1 ,Y 1 ) 
r(p, state(X, Y), state(Xi, Yi), 0) <- X * Y = X 1 * Yi, sia£e(X, Y),state(X 1 ,Y 1 ) 

which reduces the number of ground rules to less than 2352 x 110 (2352 x 99 for 
the sum, 2352 x 10 for the product) in total. Intuitively, these rules indicate that 
there is a link labeled s between state(x, y) and state(x', y') iff a; + y = x' + y', and 
there is a link labeled p between state(x,y) and state(x',y') iff x x y — x' x y'. 
Using these rules, Clingo/Smodelsj is able to find a model (i.e., a possible Kripke 
structure) within a few seconds. 

In order to verify that the generated Kripke structure satisfies the initial state- 
ments of the story, we will need to introduce fluents of the form sum(S) and 
product(S) to denote the sum and product of the two numbers of a state S = (X, Y). 
We would also need to have fluents of the form x[S) and y(S) to represent that x 
and y are the two components of the state S. 

The rules describing the truth values of the fluents are: 

h(x(X),state(X, Y)) <- h(sum(S), state(X, Y)) <- S = X + Y 

h(y(Y),state(X, Y)) <- h(product(P) , state(X, Y)) <- P = X *Y 

With these fluents, we can define a formula stating that an agent knows the value 
of the two numbers by sJcnows = \J state / x v \ K s {x{X) A y(Y)) and p .knows = 

V stately) K P (X(X)*V(Y))- 

We got the "Out of memory" message in Clingo. Lparse did not finish. 
3 potassco.sourceforge.net www.tcs.hut.fi/Software/smodels 
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The initial pointed Kripke structure is one that satisfies the formula ->p-knows 
and k s (—<p -knows). This is what p and s state in their first announcement, respec- 
tively. Thus, to construct the initial pointed Kripke structure, we will need to add 
the rules defining the predicate k(Agent, State, Formula) and other rules relating 
to this predicate. We will also need to add the constraints 

<— real(X, Y), not k(p,state(X,Y),p_knows) 

<— real{X, Y), not k(s, state{X, Y), ->k(p, state{X, Y),pJtnows)) 

The first constraint corresponds to p's first statement and the second to s's first 
statement. Adding these rules to the program, the ASP program does not find a 
model within two hours. The main culprit is the number of ground rules that need 
to be generated before the answer set can be computed. For instance, the number of 
rules defining nJc, (as described in the previous section) is roughly 2352 2 (quadratic 
to the number of the states). 

Many of these complications can be avoided by changing the model of compu- 
tation from a bottom-up model (as used by ASP) to a top-down one (as used by 
Prolog). The Prolog encoding builds the similar clauses as described for ASP, to 
verify validity of a formula in a Kripke structure. The advantage is that, by op- 
erating top-down, the components of the structure are computed when requested 
(instead of being precomputed a priori during grounding). 

We will now present a Prolog encoding for computing the initial pointed Kripke 
structure for a multi-agent theory. Each Kripke structure can be encoded using 
terms of the form kripke (N , E) where N is a list of nodes and E a list of edges. Each 
node is a term node (Name, Interpretation), where Name is a name for the node 
and the interpretation is encoded as a list of terms value (Fluent , true/false). 
A pointed Kripke structure is encoded as a term sit (kripke (N,E) , Node) where 
Node is an element from the list N. The clauses to express the validity of a formula 
are very similar to the one presented earlier, e.g.Q 

hold(F, sit (kripke (_Nodes,_Edges) ,N)) :- 

fluent (F) ,! , N = node(_Name, Int) , member(value(F,true) , Int) . 
hold(neg(F), Sit) :- \+hold(F,Sit) , !. 
hold(k(A,F), sit (kripke (N , E) , node (X,_))) :- 

findall(M,member(edge(X ) M,A) ,E) .Nodes) , iteratedjiold (Nodes ,F .kripke (N,E) ) . 
iterated_hold( [],_,_). 
iteratedjiold ([A IB] ,F, kripke(N.E)) :- 

member(node(A,I) ,N) , hold(F, sit (kripke(N.E) ,node(A,I) )) , 

iteratedjiold (B,F, kripke (N,E)) . 

In the sum-and-product example, the initial Kripke structure can be implicitly 
defined using implicit rules to construct the edges of the graph: 

edge (node (Nl, Int 1) ,node(N2,Int2) ,s) :- 

member (value (x(X) ,true) ,Intl) , member (value (y(Y) ,true) ,Intl) , 

member (value(x(Xl) , true) ,Int2) , member (value (y(Yl) ,true) , Int2) , X+Y=:=X1+Y1. 

edge (node (Nl, Int 1) ,node(N2,Int2) ,p) :- 

4 The explicit representation of interpretations can be easily replaced with implicit encodings 
whenever specific domain knowledge is available. 
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member (value (x(X) ,true) ,Intl) , member (value (y(Y) ,true) ,Intl) , 
member(value(x(Xl) ,true) ,Int2) , member (value (y(Yl) ,true) , Int2) , X*Y =:= X1*Y1. 

The Prolog implementation of the announcements as constraints on the Kripke 
structure allows us to quickly converge on identifying x — 4 and y — 13 as the 
real state of the pointed Kripke structure in a matter of seconds (10.5 seconds on 
a MacBook Pro, 2.53GHz core duo). 



5 The Semantics of m.4 

We will now describe the semantics of va.A, based on the construction of a transition 
function. For the sake of simplicity, in this manuscript we will restrict our discussion 
to domains where the initial state of the domain is described by one pointed Kripke 
structure and the actions are deterministic. Thus, the transition function is a map 
from a pointed Kripke structure and an action to another pointed Kripke structured 



5.1 Basic Kripke Structure Transformations 

We start by introducing some basic transformations of Kripke structures necessary 
to model the evolution in models caused by the execution of actions. We also show 
how, following the representation of Kripke structures discussed in Section [21 it is 
possible to naturally encode these operators in Prolog. 

Given a Kripke structure M, a set of states U C MfS 1 ], and a set of arcs X 
in M, M © U is the Kripke structure M' defined by (i) M'[S] = M[S] \ U; (ii) 
M'[tt](s)(/) = M[w](s)(f) for every s € M'[S] and / e T; and (Hi) M'[i] = 
M[i]\{(t,v) | (t,v) £ M[i], {t,v}nlf ^ 0} for every agent i € A. Intuitively, MeU 
is the Kripke structure obtained by removing from M all the states in U. 

s 

The operator is encoded by the following Prolog rules: 

node_mimis (kripke (N, E) , S, kripke (Nl , El)) :- 

delete(N,S,Nl) , remove_node_edges(S,E,El) . 
remove_node_edges( [] ,E,E) . 
remove_node_edges( [A|B] , E, NewEs) :- 

remove_one_node_edges(A,E, Esl) , remove_node_edges(B, Esl, NewEs) . 
remove_one_node_edges(_, [],[]). 
remove_one_node_edges (node (Node ,Int) , [edge(Nl ,N2,_) |Rest] , Result) :- 

(Nl=Node ; N2 = Node) , ! , 

remove_one_node_edges (node (Node, Int) , Rest, Result). 
remove_one_node_edges(N, [E I Rest] , [E I Result]) :- 

remove_one_node_edges(N,Rest .Result) . 

MQX is a Kripke structure, M', defined by (i) M'[S] = M [S]; (ii) M'[n] = M[n]; 
and (Hi) M'[i] = M[i] \ {(u,v) \ (u,i,v) € X} for i e A. M Q X is the Kripke 

a 

structure obtained by removing from M all the arcs in X . The encoding of is: 

5 It is easy to generalize this to maps where the possible configurations are described by sets of 
pointed Kripke structures and the actions are non-deterministic. 
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edge_minus(kripke(N,E) , Es, kripke(N,El) ) :- delete(E,Es,El) . 

Given two Kripke structures M\ and M 2 , we say that M\ is c- equivalent to Mi 
(Mi ~ M 2 ) if there exists a bijective function c : M\ [S] — > M2[S] such that: (i) for 
every ugS and /£ J, M\\n\{u)(f) — true iff M2[7r](c(u))(/) = true; and (m,) for 
every i e .4 and u, v e Mi [5], (w, u) £ M[i] iff (c(u),c(u)) 6 M 2 [i]. 

Mi and M2 are compatible if for every s e A/i[S l ] n M2[S I ] and every f £ J 7 , 
Mi [7r]( S )(/)=M 2 [7r] («)(/). 

For two compatible Kripke structures Mi and M2 , we define Mi U M2 to be the 
Kripke structure M', where (i) M' [5] = M X [S]UM 2 [S}] (ii) M'[tt] = M x [tt] o M 2 [tt] 
and (m) M'[z] = Mi[i] U M 2 [i\. The encoding in Prolog of Mi U M 2 is 

union_kripke (kripke (Nl, El ) , kripke (N2.E2) , kripke (N3 , E3) ) :- 

append (N1,N2,N4) , remove_dups(N4,N3) , append (El ,E2,E4) , remove_dups(E4,E3) . 

For a pair of Kripke structures Mi and M2 with Mi [S] PI M2 [S] = 0, a C A, and 
a one-to-one function A : M2 [S] — > Mi [S] , we define Mi W^ M2 to be the Kripke 
structure M', where (i) M'[5] = Mj[5] U M 2 [5]; («) M'[tt] = Mi[tt] o M 2 [tt]; (Hi) 
M'[i] = Mi[i] U M 2 [i] for each i G a, and M'[i] = Mi[i] U M 2 [i] U {(u,v) \ u 6 
Mais'], u e Mi [5], (A(w),u) G Mi[i]} for each agent i E A \ a. 

Intuitively, the operators U and W^ allow us to combine different Kripke structures 
representing knowledge of different groups of agents, thereby creating a structure 
representing the knowledge of all the agents. The encoding of ttl„ in Prolog is: 

knowledge_union(kripke(Nl,El) , kripke (N2 , E2) , Alpha, Map, kripke (N3, E3) ) :- 

check_k_union_properties(Nl,N2,Map) , union_list (Nl ,N2,N3) , 

generate_k_union_edges(El , N2, Alpha, Map, NewOnes) , 

union_list(El,E2,E4) , union_list(E4, NewOnes, E3) . 
generate_k_union_edges( [] , _, _, _, [] ) . 
generate_k_union_edges( [edge (_,_, Label) |Rest] , Nodes .Alpha, Map, NRest) :- 

member (Label, Alpha) , ! , generate_k_union_edges(Rest , Nodes .Alpha, Map, NRest) . 
generate_k_union_edges( [edge(Start , End, Label) |Rest] , Nodes, Alpha, 

Map, [NEdge I NRest] ) :- 

member( [N, Start] , Map), NEdge = edge (N, End, Label) , 

generate_k_union_edges (Rest , Nodes , Alpha , Map , NRest ) . 

Several types of actions require the creation of "copies" of a Kripke structure, 
typically to encode the knowledge of the agents that are unaware of actions being 
executed. Let (M, s) be a pointed Kripke structure, and a be a set of agents: 

• A pointed Kripke structure (M',c(s)) is a replica of (M,s) if M' ~ M and 
M'[S]nM[S] =0; 

• (M,s)\ a = (MeX,s) where X = \J iea {(u,i,v) \ (u,v) £ M[i\}; 

A replica of a pointed Kripke structure (M, s) refers to a copy of (M, s) with respect 
to a bijection c. The pointed Kripke structure (M, s)\ a , referred to as the restriction 
of (M, s) on a, encodes the knowledge of the agents in the set A\a. In Prolog: 

6 This form of equivalence is similar to the notion of bisimulation in (Baltag and Moss 2004). 

7 More precisely, M'[7r](s)(/) = Mi [tt] (s) (/ ) if s € M ± [S] and M'[ir](s)(f) = M 2 [n](s){f) if 
seM 2 [S]\Mi[S]. 
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replica(kripke(N,E) , kripke(Nl ,E1) , Map) :- 

replica_nodes(N,Nl,Map) , replica_edges(E,Map,El) . 
replica_nodes ([],[],[]). 

replica_nodes( [node (Name, Int) I Rest] , [node(NewName,Int) iNewRest] , 
[ [NewName , Name] I RestMap] ) : - 

new_state_name(NewName) , replica_nodes (Rest ,NewRest, RestMap) . 
replica_edges ([],_,[]). 
replica_edges( [edge (Start , End, Agent) I Rest] , Map, 

[edge(NewStart,NewEnd, Agent) I NewRest] ) :- 

member ( [NewStart, Start] , Map) , member ( [NewEnd,End] ,Map) , 

replica_edges (Rest , Map , NewRest) . 
remove_agent_edges(kripke(N,E) , Alpha, K) :- 

collect_agent_edges(E, Alpha, Edges) , edge_minus(kripke(N,E) , Edges, K) . 
collect_agent_edges ([],_,[]). 
collect_agent_edges( [edge(Start, End, Agent) |Rest] , Alpha, 

[edge(Start, End, Agent) INewRest]) :- 

member (Agent , Alpha) , ! , collect_agent_edges(Rest , Alpha, NewRest) . 
collect_agent_edges( [_ iRest] , Alpha, NewRest) :- 

collect _agent_edges (Rest , Alpha , NewRest) . 



5.2 Action Transition Function 

The following definitions are used to determine, given a pointed Kripke structure 
(M,s), what are the pointed Kripke structures obtained from the execution of an 
action. We will denote with succ(a, (M,s)) the pointed Kripke structure resulting 
from the execution of the action a in (M,s). Observe that in the following defi- 
nitions we view a set of literals as the conjunction of its elements. We will define 
succ(a, (M, s)) for each type of action. Let a be an action. By pre(a) we denote the 
formula <5, the condition in the law of the from ([T]) whose action is a. We begin with 
the public announcement action. 

Public Announcement: Consider a pointed Kripke structure (M, s) and an action in- 
stance a occurring in an announcement law ([3]) such that (M, s) \= 0. The successor 
pointed Kripke structure after the execution of a in (M, s) is defined as follows. If 
(M, s) Y= pre(a), then succ(a, (M, s)) is undefined, denoted by succ(a, (M, s)) = _L 
The first case deals with the assumption that the action should be executable in 
(M, s) — otherwise the resulting successor pointed Kripke structure is undefined. 
If (M, s) |= <fr then we have different cases depending on the structure of <j>. If <j> is a 

fluent formula then succ(a, (M, s)) = (M Q U, s) for U = {s' \ $' e M[S], (M, s') ^ 
</>}. This can be captured by the following rules: 

succ (sit (kripke (N, E) ,S) , public (Phi), sit (kripke (Nl , El) ,S) ) :- 

f luent_formula(Phi) , ! , 

get_nodes_not_satisfy_f ormula(Phi, kripke(N,E), Nodes), 

node_minus(kripke(N,E) , Nodes, kripke (Nl ,E1) ) . 
get_nodes_not_satisf y_f ormula(Phi , kripke(N,E), Nodes) :- 

iterate_not_satisfy(N,Phi ,kripke(N,E) , Nodes) . 
iterate_not_satisf y ( [],_,_,[]). 
iterate_not_satisfy( [A|B] ,F,K,Rest) :- 

hold(F,sit(K,A)) , !, iterate_not_satisf y (B,F,K,Rest) . 
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iterate_not_satisfy( [A I B] , F, K, [AlRest]) :- iterate_not_satisfy (B,F,K,Rest) . 

a 

If (j) = Kiip, then succ(a,(M,s)) = (MQX,s) where X = {(u,i,v) \ (u,v) e 
M[i], (M,v) \£ ip}. This is captured by the following rules: 

succ(sit(kripke(N,E) ,S) , public(Phi), sit (kripke(Nl ,E1) ,S)) :- 

Phi = k(A,Psi), iluent_formula(Psi) , !, 

get_edges_not_satisf y(E, A, Psi, kripke(N,E), Edges), 

edge_minus(kripke(N,E) , Edges, kripke(Nl ,E1)) . 
get_edges_not_satisfy( [],_,_,_, [] ) . 
get_edges_not_satisfy( [Edge iRest] , Agent, Psi, kripke(N,E) , [Edge I Result] ) :- 

Edge=edge (Start , End, Agent) , member (node (End, Int) , N) , 

\+ hold(Psi, sit(kripke(N,E) , node(End, Int)) ) , !, 

get_edges_not_satisf y (Rest , Agent ,Psi,kripke(N,E) , Result) . 
get_edges_not_satisfy( [_ IRest] , Agent , Psi, K, Result) :- 

get_edges_not_satisf y (Rest , Agent , Psi, K, Result) . 

If cp = -.(Ki^VKi-iV)) then succ(a,(M,s)) = (M QU,s) where U={s' \ s' E 
M[S], (At, s') |= Kitp V Ki^ip}. We omit the Prolog code due to lack of space. 

If the announcement happens in a pointed Kripke structure {M, s) where (M, s) \= 
ip, then we need to ensure that ip is common knowledge (strictly speaking, this is the 
belief of the agents) among the agents of the system. This accounts for our removal 
of all nodes s' such that (M, s') \£ (p. Similarly, if a formula "Kiip is announced, 
we only remove arcs labeled by i from M whose existence invalidates the formula 
Cj{Kiip. On the other hand, when a formula -i(Kj^VKp^i) is announced, we need 
to remove states in M whose existence invalidates the formula (^-'(K^ V Kj-i^i) 

Continuing with Example [TJ the execution 
of the action peek (a, c) in the initial Kripke 
structure described earlier transforms the Kripke 
structure as illustrated in Figure [1] where the 
double circle identifies the real state of the 
world, H denotes a state where tail is false 
and T denotes a state where tail is true. _. „ _, „ 

Fig. 1: Execution of peek(a,c) 

Private Announcement: Consider a pointed Kripke structure (M, s) and a private 
announcement action a with (3 ^ A, where the effect is the literal £ and (M, s) |= £. 
Let us also assume that / is the fluent used in the literal i. The pointed Kripke 
structure (M', s') is the successor model after the execution of a in (M, s) if: 

• (M,s) |= pre(a) then (M',s') = (M,s) W^ (M r \ AV/3ul) Q X,c(s)) where 

i e P,(u,v) €M[i], 
M[tt](«)(/)^ M[tt] («)(/) 




(M r , c(s)) is a replica of (M, s) and X = i (u, i, v) 

• (M,s) ^pre(a) and (M',s') = _L. 
The general successful case can be captured as: 



succ (sit (kripke (N,E) ,S) , private (Phi, Alpha, Beta) , sit (kripke (Nl , El) ,Stl)) 
get_literal_fluent(Phi,F) , replica(kripke(N,E) , kripke (N2, E2) , Map), 
non_agents(Alpha,Beta,RemAgs) , 

remove_agent_edges (kripke (N2, E2) , RemAgs , kripke (N3, E3) ) , 
catch_discriminating_edges(E3,kripke(N3,E3) , Alpha, F, X) , 
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edge_minus (kripke (N3 , E3) , X , kr ipke (N4 , E4) ) , 

append(Alpha,Beta, AlphaBeta) , 

knowledge_union(kripke(N,E) , kripke (N4 , E4) , AlphaBeta, Map,kripke(Nl,El) ) , 

S = node (NameS, _) , member([Sl, NameS] ,Map) , member (node (SI, Intl) ,N1) , 

Stl = node (SI, Intl) . 

The predicate non_agents collects all agents not in Alpha and Beta. The pred- 
icate catch_discriminating_edges identifies edges for which the agents in Alpha 
see distinct truth values for the considered literal: 

catch_discriminating_edges( [],_,_,_,[]). 

catch_discriminating_edges( [Ed| Rest] , kripke(N.E), Alpha, F, [Ed| NewRest] ) :- 
Ed = edge ( St ar t , End, Agent) , member (Agent , Alpha) , 
member (node (Start , Intl) , N) , member (node (End, Int2) , N) , 
member ( value (F, VI ) , Intl), member (value (F, V2) , Int2) , VI \= V2, !, 
catch_discriminating_edges(Rest , kripke(N,E), Alpha, F, NewRest). 

catch_discriminating_edges( [_ I Rest] , K, Alpha, F, NewRest) :- 
catch_discr iminat ing_edges (Rest , K , Alpha , F , NewRest ) . 

Sensing: Let (M, s) be a pointed Kripke structure and a be a sense action. A model 
(M', s') is a successor model after the execution of a in (M, s) if: 
(M', s') = (M, s) b^ u/3 (M r \ AVaU0) 9 X, c(s)) 
for X = {(u,i,v) | i G a,(u,v) G M r [i] , M r [tt] (u) (/) + M r [n]{v)(f)} and some 
replica (M r , c(s)) of (M, s). The Prolog code is similar to the private announcement: 

succ(sit(kripke(N,E) ,S) , sense (F, Alpha, Beta) , sit (kripke (Nl, El) ,Stl)) :- 

replica(kripke(N,E) , kripke (N2, E2) , Map), non_agents (Alpha, Beta, RemAgs) , 

remove_agent_edges (kripke (N2, E2) , RemAgs, kripke (N3, E3) ) , 

catch_discriminating_edges(E3,kripke(N3,E3) , Alpha, F, X) , 

edge_minus (kripke (N3, E3) , X, kripke(N4,E4) ) , append(Alpha, Beta, AlphaBeta) , 

knowledge_union(kripke(N,E) , kripke(N4,E4) , AlphaBeta, Map,kripke(Nl,El) ) , 

S = node (NameS, _) , member([Sl, NameS], Map), 

member (node (SI, Intl) ,N1) , Stl = node (SI, Intl) . 

World- altering Action: the computation of the successor pointed Kripke structure 
for world-altering actions requires the modification of the interpretations associated 
to certain states. Given an interpretation 7r and a set of literals <p, let us denote with 
[tp]ir the interpretation obtained by performing the minimal amount of modifications 
to 7r to ensure that [ip]w makes all the literals in ip true. Let u € Af [S 1 ] and let us 
consider an axiom of type ([2]); the axiom is applicable in u if {M, u) \= ip. We define 

, , J [<^]M[tt](w) if a causes ip if ip performed_by a applicable in u 
res \ a ' u ) ~ | M[ir](u) otherwise 

Let a be a world-altering action. By Res(a, M,a) we denote the Kripke structure 
M' which is obtained from M as follows: 

• M'[)S] = {r(a,u) \ M[ir](u) \= pre(a)} where, for each state u G M[S'], r(a,u) 
denotes a new and distinguished state symbol; 

• M'[ir](r(a, u)) = res(a, u); 

• (r(a,u),r(a,v)) G M'[i] if (u,v) G M[i] and r(a,u),r(a,v) G M'[s\ for i G a. 
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Let (M, s) be a pointed Kripke structure and let a be a world-altering action. The 
successor pointed Kripke structure of a in (M , s) is defined as follows. 

1. If (M, s) y= pre(a) then succ(a, (M, s)) = _L 

2. If (M, s) Y= pre(a) then succia, (M, s)) is the pointed Kripke structure (M', s'): 

• M'[S] = Q[S]UM[S]; 

• M'[tt](u) = M[tt](u) for u G M[5] and M'[tt](u) = Q[n](u) for u G Q[5]; 

• M'[i] = M[i] U Q[i] U i?(i) where i?(i) = for i G a and i?(i) = 
{(r(o,«),v) | r(a lU ) €Q[S],v£ M[S],(u,v) G M[i]}; and 

• s' = r(a, s). 

where Q — Res(a, M, a), and a causes tpifip performed_by a is the axiom 
of a applicable in s. 

This can be mapped to the following Prolog encoding: 

succ(sit(kripke(N,E),S) , altering (If .Then .Alpha) , sit (kripke(Nl ,E1) ,Stl) ) :- 

replica(kripke(N,E) , kripke (N2, E2) , Map), non_agents (Alpha ,[] .Gamma) , 

remove_agent_edges (kripke (N2 , E2) , Gamma, kripke (N3, E3) ) , 

update_interpretations(N3,kripke(N3,E3) , If , Then, N4) , 

knowledge_union (kripke (N, E) , kripke(N4,E3) , Alpha, Map, kripke (Nl , El)) , 

S = node (NameS, _) , member([Sl, NameS],Map), 

member (node(Sl, Intl) ,N1) , Stl = node(Sl ,Intl) . 
update_interpretations( [],_,_,_,[]). 
update_interpretations( [node (Name, Inter) I Rest] , K, If, Then, 

[node (Name , Newlnter ) I NewRest] ) : - 

(hold(If , sit (K ,node (Name , Inter) ) ) -> 

change_interpretation(Then, Inter , Newlnter) ; Newlnter = Inter), 

update_interpret at ions (Rest ,K,If , Then, NewRest) . 
change_interpretation(F,Il,I2) :- literal (F) , ! , single_update(F,Il,I2) . 
change_interpretation(and(Fl ,F2) , II, 12) :- 

change_interpretation(Fl , II ,13) , change_interpretation(F2, 13,12) . 
single_update(L, II, 12):- get_literal_f luent (L,F) , delete(Il, value(F,_), 13), 

(fluent(L) -> 12 = [value (F, true) I 13] ; 12 = [value (F, false) 113]) . 



5.3 Query Answering and Planning in Prolog 

The previous encoding can be used to support hypothetical reasoning and planning 
in multi-agent theories. To answer queries of the form (O we can use the standard 
rules for computing the successor states of a sequence of action and verify the 
desirable properties in the final successor state. This is encoded as 

hold (Query ,Seq) :- initial(sit (kripke(Nodes .Edges) ,Node)) , 

succ(sit (kripke(Nodes .Edges) , Node) , Seq, S) , hold(Query, S) . 

succ (sit (kripke (Nodes, Edges) ,Node) , [] , sit (kripke (Nodes, Edges) ,Node)) . 

succ (sit (kripke (Nodes, Edges) , Node) , [A I Seq], succ(S, Seq) ) : - 
succ (sit (kripke (Nodes, Edges) , Node) , A, S) . 

where init(S) denotes that S is the initial pointed Kripke structure and hold(F, S) 
is the predicate that determines whether F holds w.r.t. S. 

For planning, we need to determine a sequence of actions that will accomplish a 
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certain state of the world. The planning perspective supported by the implementa- 
tion below is that of an external observer, who has complete knowledge about the 
capabilities of the different agents. A standard depth-first planner can be expressed 
using the following definition of the predicate depthplan(S', Plan, N) — where S is 
the initial pointed Kripke structure, N is a bound on the maximal length of the 
plan, and Plan is the actual sequence of actions. 

depthplan(S, Plan.N):- depthplan(S, [] ,Plan,N) . 

depthplan(S, Planln, Planln,_):- terminated (S) . 

depthplan(SO, Planln, PlanOut ,N) :- length (Planln , M) , M < N, choose_action(A,SO) , 

build_action(A,Fmt) , succ(SO,Fmt ,S1) , depthplan(Sl , [A I Planln] , PlanOut, N) . 
choose_action(A,S) :- action(A,_), valid(A,S) . 

The predicate builcLaction perform a simple syntactic rearrangement of the 
action representation (not reported). The predicate valid is used to ensure that 
the action is executable in the given pointed Kripke structure: 

valid(A,S):- action(A,_Type) , executability(A, Condition) , hold(Condition,S) . 

The test for termination ensures that the goal has been achieved: 

terminated(S) :- goal(Phi), hold (Phi, S). 

As another example, it is easy to rewrite the planner to perform a breadth-first 
exploration of the search space. 

breadthplan(S,Plan,N) :- breadthplan(S,Plan,0,N) . 

breadthplan(S,Plan,M,N) :- M<N, plan(S,Plan,Sl) , length (Plan, M) , terminated(Sl) . 
breadthplan(S,Plan, M, N) : - M < N, Ml is M+l, breadthplan(S,Plan,Ml,N) . 
plan(Sl, [] ,S1) . 

plan(S0, [A|B] ,S) :- plan(SO,B,Sl) , build_act ion (A, Format ) , 
valid(A,Sl), succ(Sl, Format ,S) . 

Other forms of reasoning, e.g., switching from the perspective of an external 
observer to the perspective of an individual agent, can be similarly encoded. 



6 Conclusion and Discussion 

In this paper, we investigated an application of logic programming technology to the 
problem of manipulating Kripke structures representing models of theories from the 
logic of knowledge. We illustrated how these foundations can be used to provide a 
computational background for a novel action language, m„4, to encode multi-agent 
planning domains where agents can perform both world-altering actions as well as 
actions affecting agents' knowledge. 

To the best of our knowledge, the encoding presented in this paper is the first 
implementation using Prolog of an action language with such a set of features. The 
use of logic programming allows a very natural encoding of the semantics of mA, 
and it facilitates the development of meta-interpreters implementing different forms 
of reasoning (e.g., observer-based planning). Let us underline that generic frame- 
works for reasoning with modal logics have been proposed (e.g., (Horrocks 1998; 
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IFarinas del Cerro et al. 2001[) ). and these could be used as external solvers to ad- 
dress the specific tasks of recomputing models — we will explore this option in our 
future work. Nevertheless, we believe the updates of Kripke structures directly per- 
formed in LP and the ability of embedding such process in a LP language, which 
offers other features (e.g., constraint solving) makes LP a more suitable avenue for 
implementing languages like mA Although the prototype has not been subjected 
to formal testing (we are working on identifying interesting domains from the liter- 
ature), simple planning tasks (e.g., develop a plan that enables agents a, c to learn 
about the status of the coin while b maintains its ignorance) can be solved within 
a few seconds of computation. A formal experimental evaluation will be part of the 
future work. 
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